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(54) VIDEO DATA ENCODER, VIDEO DATA ENCODING METHOD, VIDEO DATA TRANSMITTER, 
AND VIDEO DATA RECORDING MEDIUM 



(57) An encoding preprocessing section supplies a 
CPU (6) with a statistic amount (index data) representa- 
tive of the feature of source video data to be encoded. 
Based on the statistic amount the CPU (6) operates the 
difficulty of encoding video data and then operates a tar- 
get encoding amount assigned to each picture of the 
video data based on the difficulty of encoding. The CPU 
(6) can perform encoding in real time without performing 

RRST PASS 



two encoding runs required for conventional two path 
encoding by feeding forward the operated target encod- 
ing amount to an encoder (4). Optimal encoding is real- 
ized depending on the pattern of the video data 
because the target encoding amount is operated 
depending on the difficulty of encoding the video data. 
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Description 
Technical Field 

s [0001 ] This invention relates to video data coding device and method for compression-coding source video data in 
accordance with the coding difficulty, a video data recording medium for recording coded data obtained by the device 
and method, and a video data transmitting device for coding video data by using a source video data coding device and 
transmitting the coded video data. 

w Background Art 

[0002] Recently, in order to carry out compression coding of source video data, a technique based on the MPEG 
(Moving Picture Experts Group) or MPEG2 standard employing motion compensation (MC) in combination with redun- 
dancy reduction processing by orthogonal transform such as discrete cosine transform (DCT) has been broadly used. 
15 [0003] This MPEG technique is used for a storage system for compression-coding each group of pictures (GOP) as 
a unit consisting of an intra-picture (l-picture). a predictive-picture (P-picture) and a bidirectionatly predictive-picture (B- 
picture) and recording the compressed data onto a recording medium such as a digital disk (for example, a magneto- 
optical (MO) disk). The MPEG technique is also used for an authoring system for recording compressed data onto a 
master disk. 

so [0004] In such storage system and authoring system, the storage capacity of the recording medium is limited, and 
therefore, the quantity of data (bits) of compressed data after compression coding must be made not greater than the 
storage capacity of the recording medium white high quality of image after expansion decoding is maintained. 
[0005] The present Assignee has proposed a technique, referred to as "two-pass encode", for temporarily encoding 
a video signal input by a fixed quantization value, then collecting data such as the quantity of generated bits, and from 

2S the result thereof, determining allocation (target quantity of codes) of the bit rate in variable rate encoding at the time of 
regular encoding. This two-pass encode system is an encoding method for optimally allocating bits to video data to be 
coded, in accordance with the coding difficulty of video images. 

[0008] Fig. 1 is a conceptual view showing an entire two-pass encode system which is used in a DVD authoring sys- 
tem for recording coded video data onto a digital video disk (DVD) or a storage system for recording coded video data 
30 onto an MO disk. 

[0007] In this two-pass encode system, in the first pass, a video signal input (Video Input) is preliminarily compres- 
sion-coded by an encoder of fixed quantization to estimate the quantity of generated bits after compression coding as 
coding difficulty, and this estimated quantity of generated tats is supplied to an external computer. Then, the external 
computer supplies the target quantity of codes based on the quantity of generated bits, that is, the coding difficulty, to 
35 the encoder. In the second pass, the encoder carries out encoding in accordance with the target quantity of codes, and 
outputs a bit stream, which is coded data. 

[0008] The two-pass encode system provides a satisfactory encode effect in terms of picture quality. However, from 
the viewpoint of operation efficiency, since encode operation must be carried out at least twice, there is such a problem 
that a long encode time is required. 
40 [0009] Also, in the storage system for recording coded video data by using an optical disk or a tape streamer in place 
of VTR, encode processing needs to be carried out in real time. Therefore, in such a storage system with the conven- 
tional technique, only encoding at a fixed coding rate can be carried out regardless of the picture quality of video data 
to be coded. 

[001 0] In short the conventional authoring system or storage system has such a problem that it is impossible to code 
45 source video data in real time while improving the picture quality of coded video data to be recorded on a storage 
medium. 

[001 1] Meanwhile, this MPEG technique is also used in a transmission system of digital broadcast for transmitting 
picture data as digital data. The advantage of digital broadcast is that a greater quantity of program data (hereinafter 
referred to as programs) than in analog broadcast can be transmitted on the same transmission fine. In compression 

so coding of a picture in this transmission system of digital broadcast, it is necessary to maintain high picture quality while 
restraining the quantity of data (bits) after cornpression coding to not more than the transmission capacity of the trans- 
mission line, similarly to the case of the storage system or authoring system. In the conventional transmission system, 
a "statistical multiplexing" method is employed as a method for transmitting a greater quantity of programs to a trans- 
mission line of a predetermined transmission capacity. Statistical multiplexing is a method for allocating an optimum 

55 transmission rate to each program by dynamically changing the transmission rate of each program in accordance with 
the contents of the program. This statistical multiplexing is adapted for reducing the transmission rate with respect to a 
program having video data of simple patterns which do not require a large quantity of bits in coding, and increasing the 
transmission rate with respect to a program having video data of complex patterns which require a large quantity of bits 
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in coding. 

[0012] In such a transmission system of digital broadcast live video programs such as sports programs and news 
programs must be transmitted in real time. However, the above-described two-pass encode system has such a problem 
that live video programs cannot be transmitted in real time, unless the video programs are transmitted at a fixed coding 
5 rate ignoring the picture quality. In short in the conventional transmission system, programs of high picture quality can- 
not be transmitted in real time. 

Disclosure of the Invention 

w [001 3] In view of the foregoing status of the art. it is an object of the present invention to provide video data coding 
device and method for carrying out in real time, variable rate coding for realizing good picture quality, and a recording 
medium for coded data. Also, it is another object of the present invention to provide a video data transmitting device for 
transmitting, in real time, data compression-coded by variable rate coding processing for realizing good picture quality. 
[0014] In order to solve the above-descrfeed problem, in a video data coding device according to the present inven- 
ts tion, a target quantity of codes to be distributed to input video data is calculated on the basts of index data indexing char- 
acteristics of the input video data, and in accordance with the target quantity of codes, coding processing is carried out 
on the input video data delayed by delay means. 

[001 5] That is, according to the present invention, there is provided a video data coding device for coding input video 
data supplied thereto, the device including: target quantity of codes calculation means for calculating a target quantity 
20 of codes to be distributed to the input video data on the basis of index data indexing characteristics of the input video 
data; delay means for delaying the input video data by a predetermined time period; and coding processing means for 
carrying out coding processing in accordance with the target quantity of codes with respect to the input video date 
delayed by the delay means. 

[0016] In this case, the time period by which the delay means delays the input video data is a predetermined time 
25 period longer than a time period during which the target quantity of codes calculation means calculates the target quan- 
tity of codes. Consequently, the index data is precedent! y read. This precedent reading is carried out for example, 
within 0.5 seconds of one GOP. 

[0017] The target quantity of codes calculation means finds a coding difficulty indicating the difficulty at the time of 
coding from the index data, and calculates the target quantity of codes to be distributed to the video data on the basis 
so of the coding difficulty. 

[0018] Also, the target quantity of codes calculation means updates, at any time, the corresponding relation of the 
target quantity of codes based on the coding difficulty, in accordance with coding difficulties that have already been col- 
lected and the quantity of codes generated by the coding processing means. 

[001 9] In order to solve the above-described problem, in a video data ceding method according to the present inven- 
35 tion. a target quantity of codes to be distributed to input video data is calculated on the basis of index data indexing char- 
acteristics of the input video data, and in accordance with the target quantity of codes, coding processing is carried out 
on the input video data delayed at a delay step. 

[0020] That is, according to the present invention, there is also provided a video data coding method for coding sup- 
plied input video data, the method including: a target quantity of codes calculation step of calculating a target quantity 
40 of codes to be distributed to the input video dab on the basis of index data indexing characteristics of the input video 
data; a delay step of delaying the input video data by a predetermined time period; and a coding processing step of car- 
rying out coding processing in accordance with the target quantity of codes with respect to the input video data delayed 
at the delay step. 

[0021 ] In this case, the time period by which the input video data is delayed at the delay step is a predetermined time 
45 period longer than a time period during which the target quantity of codes is calculated at the target quantity of codes 
calculation step. Consequently, the index data is precedent ty read. This precedent reading is carried out, for example, 
within 0.5 seconds of one GOP 

[0022] At the target quantity of codes calculation step, a coding difficulty indicating the difficulty at the time of coding 
is found from the index date, and the target quantity of codes to be distributed to the video date is calculated on the 
so basis of the coding difficulty. 

[0023] Also, at the target quantity of codes calculation step, the corresponding relation of the target quantity of codes 
based on the coding difficulty is updated at any time, in accordance with coding difficulties that have already been col- 
lected and the quantity of codes generated at the coding processing step. 

[0024] In the video data coding device of the present invention, a coding preprocessing section supplies, to a CPU. a 
55 statistic quantity (index data) indicating characteristics of source video data to be coded. The CPU calculates a coding 
difficulty indicating the difficulty in coding the video data, on the basis of the statistic quantity, and calculates a target 
quantity of codes allocated to each picture of the video data, on the basis of the coding difficulty. In addition, the CPU 
feeds forward the calculated target quantity of codes to an encoder, thereby enabling coding processing in real time 



3 



EP 0 924 933 A1 



without carrying out encode processing twice as in the conventional two-pass encode processing. Moreover, in the 
video data coding device of the present invention, since the target quantity of codes in accordance with the coding dif- 
ficulty of video data is calculated, optimum coding in accordance with the pattern of video data can be realized. 
[0025] In the video data coding device and method of the present invention, the CPU calculates a coding difficulty Dj 

5 indicating the coding difficulty in coding source video data from the source video data to be coded itself, and calculates 
a target quantity of codes Tj used in cooing the source video data to be coded, on the basis of the calculated coding 
difficulty. Then, the CPU supplies the calculated target quantity of codes Tj to an encoder in a manner of feed forward, 
thereby enabling coding based on the target quantity of codes in accordance with the pattern of the source video data 
to be coded and also enabling coding of the video data in real time. 

io [0026] In addition, in the video data coding device of the present invention, since the coding drfficutty is proximately 
calculated for each picture type by using intra- AC or ME residual found from the source video data to be coded, the cod- 
ing drfficutty can be obtained before the video data to be coded is actually encoded. Therefore, real-time coding 
processing can be realized. 

[0027] Moreover, in the video data coding device of the present invention, if the picture type of video data to be coded 
is is I -picture, the coding difficulty is calculated from intra -AC. whereas if the picture type of video data to be coded is P- 
picture or B-ptcture. the coding difficulty is calculated from ME residual. Thus, the coding difficulty with high precision 
can be calculated in accordance with the picture type. 

[0028] In addition, in the video data coding device of the present invention, since a conversion formula for calculating 
the target quantity of codes from the calculated coding difficulty is corrected at any time on the basis of the actually gen- 

so erated coding quantity as a result of the past coding processing by coding means, the target quantity of codes adapted 
to a change of pattern of video data and target coding corresponding to the remaining quantity of a storage medium can 
be set. Furthermore, as the conversion formula for calculating the target quantity of codes from the coding difficulty, dif- 
ferent conversion formulas are set in accordance with the picture type of the video data to be coded. Therefore, the opti- 
mum coding difficulty can be calculated not only on the GOP basis but also on the picture basis. 

25 [0029] Moreover, in the video data coding device of the present invention, the operation expression for calculating the 
coding difficulty is updated at any time on the basis of global complexity found from the quantity of generated codes and 
the quantization value of coding processing by coding means. Therefore, the coding difficulty in accordance with a 
change of pattern of video data can be detected with higher precision. 

[0030] In addition, in the video data coding device of the present invention, the CPU calculates, for each picture, cod- 
30 ing diff icutties related to a plurality of pictures included in a reference GOP to be a target of coding processing by coding 
means, and calculates the target quantity of codes allocated to the reference GOP from the plurality of coding difficul- 
ties calculated by coding difficulty calculation means. The CPU distributes the target quantity of codes allocated to the 
reference GOP. to each picture included in the reference GOP in accordance with the picture type, thereby calculating 
the target quantity of codes corresponding to each picture included in the reference GOP. Thus, different target quanti- 
35 ties of codes in accordance with the picture type can be allocated to the respective pictures while an average quantity 
of codes designated to the GOP is maintained within the GOP. 

[0031] According to the present invention, there is also provided a video data transmitting device for coding input 
video data supplied thereto and transmitting the coded video data, the device including: target quantity of codes calcu- 
lation means for calculating a target quantity of codes to be distributed to the input video data on the basis of index data 
40 indexing characteristics of the input video data; delay means for delaying the input video data by a predetermined time 
period; and coding transmission means for carrying out coding processing in accordance with the target quantity of 
codes with respect to the input video data delayed by the delay means and transmitting the coded video data. 
[0032] According to the present invention, there is also provided a video data transmitting device for coding source 
video data and transmitting the coded video data, the device including: coding difficulty calculation means for calculat- 
es ing a coding difficulty indicating the coding difficulty in coding the source video data; target quantity of codes calculation 
means for updating, at any time, an operation expression for calculating a target quantity of codes used in coding the 
source video data from the calculated coding difficulty, on the basis of the quantity of generated codes in the past cod- 
ing processing, and calculating the target quantity of codes from the coding drfficutty on the basis of the updated con- 
version formula; coding means for feeding forward the target quantity of codes calculated by the target quantity of codes 
so calculation means, thereby coding the source video data to be coded in real time on the basis of the target quantity of 
codes corresponding to the source video data to be coded; and transmission means for transmitting the video data 
coded by the coding means. 

[0033] According to the present invention, there is further provided a video data recording medium in which coded 
data is recorded, the coded data being obtained by calculating a target quantity of codes to be distributed to input video 
55 data on the baste of index data indexing characteristics of the input video data, and then carrying out coding processing 
in accordance with the target quantity of codes with respect to the input video date delayed by a predetermined time 
period. 
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Brief Description of the Drawings 
[0034] 

5 Rg.1 is a view for explaining a conventional two-pass encode system. 

Fig. 2 is a block diagram showing an embodiment of the video data coding device and method according to the 
present invention. 

Fig. 3 is a block diagram showing the detailed structure of a compression coding section, which is an essential part 
of the embodiment. 
w Fig. 4 is a view for explaining the principle for calculation of flatness. 

Figs, 5 A to 5C are timing charts for explaining the operation of the embodiment 

Fig. 6 is a graph of the GOP bit rate with respect to the coding difficulty for explaining the operation of the embodi- 
ment 

Fig. 7 is a graph showing the state where the graph of Fig. 6 is updated. 
is Fig. 8 is a flowchart for explaining the operation of the embodiment. 

Fig.9 is another graph of the GOP bit rate with respect to the coding difficulty. 

Figs. 10A to 10D are graphs of the frame target quantity of codes with respect to the coding d iff cutty of I-. P- and 
B-pictures, respectively. 

Fig. 11 is a block diagram showing another specific example oi the video data coding device and method according 
20 to the present invention. 

Fig. 12 is a block diagram showing still another specific example of the video data coding device and method 
according to the present invention. 

Best Mode for Carrying Out the Invention 

25 

[0035] Preferred embodiments of the video data coding device and method according to the present invention will 
now be described with reference to the drawings. 

[0036] Fig. 2 is a view showing the structure of a video data coding device according to an embodiment of the present 
invention. This video data coding device includes a coding preprocessing section 2 for calculating index data indexing 

30 characteristics of an input video signal inputted from an input terminal 1 , and a central processing unit (CPU) 6 as target 
quantity of codes calculation means for finding a coding difficulty indicating difficulty at the time of coding the input video 
signal on the basts of the index data from the coding preprocessing section 2 and calculating a target quantity of codes 
to be distributed to the video signal on the basis of the coding diff iculty. The video data coding device also includes a 
FIFO memory 3 as delay means for delaying the input video signal by a predetermined time period, and an encoder 4 

35 for caring out coding processing in accordance with the target quantity of codes with respect to the input video signal 
delayed by the FIFO 3 and supplying the compressed video data to an output terminal 7. 

[0037] In the case where the coding device shown in Fig.2 is applied to a storage system or an authoring system, 
coded video data outputted from the output terminal 7 is stored on a data storage medium such as an optical disk. In 
the case where this coding device is applied to a transmission system of digital broadcast or the like, coded video data 
40 outputted from the output terminal 7 is multiplexed with other coded video programs and then transmitted to a receiving 
device through a transmitting device or a satellite, not shown. 

[0038] The CPU 6 may be constituted in a casing unit including the coding preprocessing section 2, the FIFO 3 and 
the encoder 4, or may be constituted as a computer for controlling the coding preprocessing section 2, the FIFO 3 and 
the encoder 4. 

45 [0039] The index data supplied from the coding preprocessing section 2 to the CPU 6 is exemplified by ME residual, 
flatness, and intra- AC as later described. 

[0040] The coding preprocessing section 2 notifies the CPU 6 of the presence/absence of pictures of a video signal 
input from the input terminal 1 , and carries out preprocessing for compression coding for each picture of the video sig- 
nal input In short the coding preprocessing section 2 rearranges video data in a GOP of the input video dab into the 

so coding order, and carries out picture-field conversion. The coding preprocessing section 2 carries out 3:2 pull-down 
conversion processing (for converting video data of 24 frames/sec of a motion picture to video data of 30 frames/sec 
and removing redundancy before compression coding) in the case where the input video data is video data of a motion 
picture, and outputs the converted data to the FIFO 3. Also, the coding preprocessing section 2 supplies to the CPU 6 
the index data such as ME residuals, flatness, and intra -AC as later described. 

55 [0041 ] A motion detection circuit 5 detects motion vectors of the video signal input and outputs the detected motion 
vectors to the coding preprocessing section 2. Also, this motion detection circuit 5 generates ME residuals. 
[0042] The FIFO 3 delays video data inputted from the coding preprocessing section 2, for example, input video data, 
by a predetermined time period and outputs the delayed video data to the encoder 4. This predetermined time period 
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is longer than a time period during which the CPU 6 calculates the target quantity of codes. 

[0043] The compression coding section including the coding preprocessing section 2, the FIFO 3, the encoder 4 and 
the motion detection circuit 5 will now be described further in detail with reference to Fig. 3. 

[0044] In the compression coding section of Fig. 3. a picture rearrangement circuit 1 1 , a scan conversion macrobJock 
5 forming circuit 12 and a statistic quantity calculation circuit 13 constitute the coding preprocessing section 2 of Fig.2. 
[0045] The picture rearrangement circuit 1 1 rearranges an inputted video signal in the coding order. The scan con- 
version macroblock forming circuit 12 carries out field-frame conversion and forms a macroblock. For example, the scan 
conversion macroblock forming circuit 12 carries out 3:2 pull -down conversion, if the video signal input is a video signal 
of a motion picture. 

w [0046] The statistic quantity calculation circuit 1 3 calculates the statistic quantity such as flatness and intra- AC from 
a picture which is processed by the picture rearrangement circuit 1 1 and the scan conversion macroblock forming circuit 
12 and compression-coded to an I -picture. 

[0047] In the compression coding section of Fig. 3. an addition circuit 15. a DCT circuit 16. a quantization circuit 1 7, a 
quantization control circuit 18, a variable length coding (VLC) circuit 19, a buffer 20, a inverse quantization (IQ) circuit 
is 22. a inverse DCT (I DCT) circuit 23, an addition circuit 24, and a motion compensation circuit 25 constitute the encoder 
4 of Ftg.2. 

[0048] The addition circuit 1 5 subtracts output data of the addition circuit 24 from the input video data from the FIFO 
3. and outputs the resultant data to the DCT circuit 16. 

[0049] The DCT circuit 1 6 carries out discrete cosine transform (DCT) on the video data inputted from the addition 
20 circuit 1 5 with respect to each macroblock consisting of 1 6x1 6 pixels so as to transform data of the time domain to data 

of the frequency domain, and outputs the data of the frequency domain to the quantization circuit 17. 

[0050] The quantization circuit 1 7 quantizes the data of the frequency domain inputted from the DCT circuit 16 by a 

fixed or arbitrary quantization value, and outputs the quantized data to the variable length coding (VLC) circuit 19 and 

the inverse quantization circuit 22. 
25 [0051] The variable length coding circuit 19 carries out variable length coding on the quantized data inputted from the 

quantization circuit 1 7. and supplies compressed video data as a result of variable length coding to the buffer 20. The 

buffer 20 buffers the compressed video data and supplies a bit stream consisting of the compressed video data to an 

output terminal 21 . 

[0052] The inverse quantization circuit 22 inversely quantizes the quantized data inputted from the quantization circuit 
30 1 7 and outputs the inversely quantized data to the inverse DCT circuit 23. 

[0053] The inverse DCT circuit 23 carries out inverse DCT on the inversely quantized data inputted from the inverse 
quantization circuit 22 and outputs the resultant data to the addition circuit 24. 

[0054] The addition circuit 24 adds output data of the motion compensation circuit 25 and output data of the inverse 
DCT circuit 23, and outputs the addition result to the addition circuit 1 5 and the motion compensation circuit 25. 
ss [0055] The motion compensation circuit 25 carries out motion compensation on the output data of the addition circuit 
24 on the basis of the motion vector calculated by the motion detection circuit 5 with respect to a reference frame, and 
outputs the resultant data to the addition circuit 1 5. 

[0056] A FIFO 26, provided between the motion compensation circuit 25 and the motion detection circuit 5, delays 
the motion vector. Since the motion vector has a smaller information quantity than picture data, the FIFO 26 may have 

40 a smaller capacity than FIFO 3. 

[0057] With the above-described structure, the video data coding device of the embodiment of the present invention 
adaptively calculates a target quantity of data Tj, by using the statistic quantity such as flatness and intra- AC of the 
video input signal and the prediction error quantity of motion prediction (ME residual) in place of the coding difficulty of 
the pattern of the input video signal. Then, the video data coding device compression-codes the input video signal to 

45 compression-coded video data of an appropriate data quantity, in accordance with the target quantity of data Tj. 

[0058] In this video data coding device, the motion detection circuit 5 and the statistic quantity calculation circuit 1 3 
generate index data of the statistic quantity and the ME residual that are detected in advance, and determine the target 
quantity of data Tj based on the index data. This compression coding system is hereinafter referred to as a feed forward 
rate control system. 

so [0059] The ME residual is defined as the absolute value sum or square value sum of difference values between video 
data of pictures to be compressed and video data of a reference pictures. The ME residual is calculated by the motion 
detection circuit 5 from pictures that become P -pictures and B-pictures after compression. It expresses the speed of 
motion of an image and the complexity of pattern, and has correlation with the coding difficulty and the data quantity 
after compression. 

55 [0060] As for I -pictures, the ME residual cannot be found because these pictures are compression-coded without 
referring to other pictures. As index data (parameters) in place of the ME residual, the flatness ad intra- AC are used. 
[0061 ] The flatness is a parameter which is newly defined as index data expressing spatial flatness of an image, in 
order to realize the video data coding device. It indexes the complexity of the image and has correlation with the coding 
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difficulty and the data quantity after compression. 

[0062] The intra-AC is a parameter which is newly defined as the sum of dispersion value between each DCT block 
of the DCT processing unit in the MPEG system and image data, in order to realize the video data coding device. Sim- 
ilar to the flatness, the intra-AC indexes the complexity of the image and has correlation with the coding difficulty and 

s the data quantity after compression. 

[0063] The method for finding the coding difficulty (so-called difficulty) with high precision by using these parameters 
is disclosed in detail in the specification and drawings of the Japanese Patent Application No. Hei 8-214708, "Video 
Data Compressing Device and Method Therefor." filed by the present Assignee on 14 August 1996 (and the U.S. Patent 
Application No. 08/909.448, filed on 1 1 August 1997.) 

to [0064] The coding difficulty (hereinafter property denoted by Dj) with respect to each picture is data indicating the dif- 
ficulty of coding at the time of coding the image pattern. As the pattern becomes more complicated, the coding difficulty 
becomes higher. Oh the contrary, as the pattern is more simplified, the coding difficulty is lowered. 
[0065] The target quantity of codes Tj is calculated on the basis of the coding difficulty Dj. Specifically, the ME residual , 
flatness and intra-AC have strong correlation with the coding difficulty Dj. Therefore, the coding difficulty Dj is calculated 

15 from the index data such as the ME residual, flatness and intra-AC, and the target quantity of codes Tj can be calculated 
from the calculated coding difficulty D r In this case, the index data can be detected by the encoder control circuit 2 and 
the motion detection circuit 5 shown in Fig. 2. That is. unlike the conventional technique, it is not necessary to find the 
coding difficulty in advance by using the two-pass encode system. 

[0066] First, the ME residual will be described in detail. In carrying out compression coding with reference to other 

20 pictures to generate P -pictures and B-pictures, the motion detection-circuit 5 searches a macroblock which realizes the 
minimum absolute value sum or square value sum of difference value between a noted macroblock of a picture (input 
picture) as a compression target and a macroblock of a picture (reference picture) to be referred to, and thus finds the 
motion vector. In short, the ME residual is defined as the sum of the minimum absolute value sum or square value sum 
of difference value of the respective macrobiocks, with respect to the whole picture, in finding the motion vector. 

25 [0067] This ME residual has extremely strong correlation with the coding difficulty Dj such as to realize substantially 
direct proportion to the coding difficulty Dj. Thus, before compression coding, the coding difficulty Dj of a picture to be 
a P -picture or B-picture is found from the ME residual, and the target quantity of codes Tj with respect to the P -picture 
or B-picture can be calculated. The specific operation expression thereof will be described later. 
[0068] Next, the flatness will be described in detail. The flatness is data expressing spatial flatness of the image. The 

30 flatness is calculated by first dividing a DCT block as a DCT processing unit in the MPEG system into subblocks each 
consisting of 2x2 pixels, then calculating the difference value of diagonal pixel data (pixel values) in these subblocks, 
then comparing the difference value with a predetermined threshold value, and finding the total number of subblocks 
having the difference value smaller than the threshold value for each picture, as shown in Fig.4. The flatness value 
becomes smaller if the image pattern becomes spatial ly complicated. The flatness value is greater if the image pattern 

35 is flatter. This flatness has strong negative correlation with the coding difficulty Dj. Thus, before compression coding, 
the coding difficulty Dj of a picture to be an I -picture is found from the flatness, and the target quantity of codes Tj with 
respect to the l-picture can be found from the flatness. 

[0069] The intra-AC is calculated as the sum of absolute values of differences between pixel values of the respective 
pixels in a DCT block and the average value of the pixel values in the DCT block, for each DCT block. That is, the irttra- 
40 AC (lntra_AC) is found by the following equation. 

tntra_AC = E[f(x, y) - (Lf)/N| 

In this equation, f(x. y) expresses the pixel value of each pixel in the DCT block, and Lf expresses the sum of pixel val- 
45 ues in the DCT block. N expresses the number of pixels in the DCT block, and L|] expresses the sum with respect to 
the pixels in the DCT Mock. 

[0070] As described above, in the case where the type of a picture to be coded is l-picture, the intra-AC found by the 
above-mentioned equation and the coding difficulty Dj have strong positive correlation. Thus, the coding difficulty Dj of 
the picture to be an l-picture can be found from the intra-AC on the basis of the following equation (1) 

so 

Dj = a, x lntra_AC + b, (1) 

[0071 ] In this equation, a, and b, are simply a coefficient and a constant for finding the coding difficulty Dj with respect 
to the l-picture from the intra-AC. 
55 [0072] Similarly, using the following equation (2) for the P -picture or using the following equation (3) for the B-picture, 
the coding difficulty Dj can be calculated from the ME residual by the CPU 6. 

D , = a p x ME_jesid . + b P (2) 
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D j = a B x ME_residj + b B (3) 

[0073] Next, the operation of the CPU 6 for finding the coding difficulty Dj by using the index data (ME residual, intra - 
AC, or flatness) will be described with reference to Frgs.2. 3 and 5. 

[0074] The picture rearrangement circuit 1 1 of the coding preprocessing section 2 rearranges a video signal input in 
the coding order, and the scan conversion macroblock forming circuit 1 2 carries out picture-field conversion. In addition, 
the statistic quantity calculation circuit 13 carries out arithmetic processing based on the above-mentioned equation for 
finding the intra-AC with respect to a picture to be compression-coded to an l-picture, thus calculating the statistic quan- 
tity such as flatness and intra-AC. 

[0075] The motion detection circuit 5 generates motion vectors with respect to pictures to be compression-coded to 
a P -picture and a B-picture, and calculates the ME residual. 

[0076] The FIFO 3 delays the source video signal inputted thereto by the amount of N pictures. This "N" is an integer 
expressing the number of pictures included in one GOP (group of pictures). 

[0077] With respect to the picture to be coded as an l-picture, the CPU 6 carries out arithmetic processing of equation 
(1) using the flatness and intra-AC outputted from the statistic quantity calculation circuit 13. thus generating the coding 
difficulty Dj for the l-picture. With respect to the pictures to be coded as a P-picture and a B-picture, the CPU 6 carries 
out arithmetic processing of equations (2) and (3) using the ME residual generated by the motion detection circuit 5, 
thus calculating the coding difficulty Dj for the P-picture and B-picture, respectively. 

[0078] At the same time, the coding preprocessing section 2 carries out preprocessing such as rearrangement of pic- 
tures in the coding order with respect to the video signal input, and outputs video data as shown in Fig. 5A to the FIFO 
3. By the rearrangement of pictures by the coding preprocessing section 2. the coding order of pictures shown in 
Figs. 5 A to 5C is caused to differ from the display order after expansion decoding. 

[0079] The FIFO 3 delays each picture of the inputted video data by the amount of N pictures and outputs the delayed 
video data to the encoder 4. Since the delayed video data inputted to the encoder 4 is delayed by the amount of N pic- 
tures by tiie FIFO 3. when the encoder 4 is compression-coding the j-th picture (picture b of Bg.SB) of the delayed video 
data as shown in Fig.5B, the coding preprocessing section 2 takes out the index data from the Q+N)th picture (picture 
a of Fig.SB) which is forward by N pictures from the j-th picture b of the video data, and supplies the index data to the 
CPU 6. The CPU 6 instantaneously uses the index date to calculate the coding difficulty Dj with respect to the l-picture, 
P-picture and B-picture on the basis of equations (1). (2) and (3). Thus, when the encoder 4 starts compression coding 
of the j-th picture of the delayed video data, the CPU 6 obtains the coding difficulties Dj to D^ N . t with respect to N pic- 
tures from the picture j to the picture j+N-1 . 

[0080] Similarly, when the encoder 4 is compression-coding the (j+1)th picture (picture b" of Fig.SC) of the delayed 
video data as shown in Fig.5C, the CPU 6 obtains the coding difficulties to D^ N with respect to N pictures from the 
picture Q+1) to the picture Q+N). 

[0081] In the TM5 (Test Model Editing Committee or "Test Model 5") system known as an MPEG compression algo- 
rithm, a statistic quantity referred to as activity is used to calculate the quantization value (MQUANT) of the macroblock. 
Since this activity has strong correlation with the coding difficulty Dj similarly to the flatness and intra-AC, the coding 
difficulty Dj may be found by using the activity instead of these index data. 

[0082] The coding difficulty Dj calculated by the CPU 6 using the index data including the activity is used for calculat- 
ing the target quantity of codes Tj. 

[0083] To simplify the description, it is assumed that the coding difficulties D j+1 to D^ obtained by the CPU 6 are for 
one GOP. It is also assumed that the number of pictures of one GOP is N. In short, when the encoder 4 encodes the 
picture j. the coding difficulties Dj to D^^ with respect to N pictures from the picture j to the picture j+N-1 are obtained, 
as described above. 

[0084] The processing by the CPU 6 for calculating the target quantity of codes Tj using the coding difficulty Dj roughly 
includes the following three types of processing. 

[0085] The first processing is processing for finding the bit rate GOP_Bitrate of a reference GOP from the average 
value D* of the coding difficulty Dj in the GOP. This first processing is referred to as processing for finding the reference 
GOP brtrate GOP_Bitrate. 

[0086] The second processing is processing for distributing the target quantity of codes allocated to the reference 
GOP in accordance with the ratio of the coding difficulties of the respective pictures, and determining the target quantity 
of codes Tj for each picture. This second processing is referred to as processing for finding the target quantity of codes 
Tj for each picture. 

[0087] The third processing is processing for updating the operation expression for determining the bit rate from the 
coding difficulty used in the first processing, by using the quantity of generated codes and the coding difficulty after 
completion of encoding of the GOP. This third processing is referred to as processing for updating the operation expres- 
sion for calculating the reference GOP bit rate GOP_Bttrate. The third processing is very characteristic and can provide 
such an encode algorithm as to satisfy the target quantity of codes while updating the relational expression. 
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to 



[0088] The first processing win now be described in detail. This processing is adapted for determining the bit rate allo- 
cated to a reference GOP to be encoded from now on immediately before encoding the leading picture of the GOP, that 
is. an l-ptature Q = 0). Therefore, first the average value D" of the coding difficulty Dj with respect to the reference GOP 
to be encoded from now on is found in accordance with the following equation (4). 



/V-1 

N 



D=^- (4) 



In this equation. D~ is equal to D" in the text, and D~ in the drawings is similarly equal to D\ 

[0089] Then, using the relation between the average value D' of the coding difficulty in this GOP and the reference 
GOP bit rate GOP_Bitrate as shown in Rg. 6. the bit rate to be allocated to the GOP is determined. Fig.6 shows the rela- 
tion between the average value D' of the coding difficulty in this GOP and the reference GOP bit rate GOP_Brtrate, as 

15 described above. The lateral axis represents the average value D" of the coding difficulty, and the longitudinal axis rep- 
resents the reference GOP bit rate GOP_Bitrate. As seen from the relational expression of Fig.6, as the average value 
D" of the coding difficulty becomes greater, a greater bit rate is allocated to the reference GOP. 
[0090] In the case where this video data coding device is applied to an authoring system or a storage system. Max 
Rate (Rate_max) and Min Rate (Rate_min) expressed on the longitudinal axis of the graph of Fig.6 are the maximum 

20 bit rate and the minimum bit rate determined by the application, respectively. If the recording capacity Total_Bit of a stor- 
age medium used in the authoring system or the storage system and the length TotaJ_Time of a video material to be 
recorded are predetermined, the average bitrate Avg Rate (Rate_Avg) expressed on the longitudinal axis is the average 
bit rate calculated from these parameters, and its initial value is calculated by the following equation. 

as Rate_Avg = Total_Bit [bitsJ/To tal_Ti me [sec] 

[0091 ] In the case where this video data coding device is applied to a transmission system of digital broadcast or the 
like. Max Rate (Rate_max) and Min Rate (Rate_min) expressed on the longitudinal axis of the graph of Fig.6 are the 
maximum bit rate and the minimum bit rate, respectively, predetermined with respect to a video program to be transmrt- 
30 ted. Similarly, the average bit rate Avg Rate (Rate_Avg) is a fixed bit rate preset with respect to the video program to be 
transmitted. 

[0092] On the other hand, Avg Drff cutty (D_Avg) expressed on the lateral axis is an estimate value of the average 
coding difficulty of an input video material to be encoded. The Avg Difficulty is referred to as the 'estimate value" 
because the coding difficulty of the input video material is not known until encoding is completed. 
35 [0093] Thus, provided with Rate_Min, Rate_Max, Rate_Avg and the average coding difficulty D_Avg, the bit rate 
GOP_Bitrate to be allocated to the reference GOP is expressed by a straight line which represents Rate_Min if the aver- 
age value D" of the coding difficulty in the reference GOP is equal to 0 and which represents Rate_Avg if the average 
value D~ is equal to D_Avg, and takes such a value that the bit rate does not exceed Rate_Max, as shown in Fig.6. Thus, 
the bit rate GOP_Bitrate to be allocated to the reference GOP is expressed by the following equation. 

40 

GOP_Bitrate = min( Rate_Min + R ate_Avg-Rate_Mm x Q.Rate_Max) (5) 

45 [0094] When the GOP bitrate GOP_Bctrate is found in this first processing (processing for finding the reference GOP 
bit rate GOP_Brtrate), a target quantity of codes R for the reference GOP is found in accordance with the following 
equation (6) in the second processing (processing for finding the target quantity of codes Tj for each picture). 

n-GOP-B*rate* pjau % Rate (6) 



[0095] In this equation. Picture_Rate is the number of pictures for second. 

[0096] Then, in this second processing, the bit quantity R per GOP found in accordance with equation (6) is distributed 
55 at the ratio of the coding difficulties of the respective pictures. That is, the bit quantity R per GOP is not distributed 
equally to each of N pictures in the GOP, but is distributed in an inclined manner so that the greatest quantity of coded 
bits is allocated to the I -picture and a quantity of bits smaller than that for the l-picture and greater than that for the B- 
picture is allocated to the P -picture while the smallest quantity of bits is allocated to the B-ptcture. Specifically, the target 
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quantity of codes Tj of the j-th picture in the GOP is determined as expressed by the following equations (7), (8) and (9). 
depending on the respective picture types. 

[0097] The target quantity of bits which is allocated in coding a picture having the picture type of I -picture is found by 
equation (7). 

r, K ^°l *R (7) 

K^xK^D^KgX £ Dp+Kpx £ D B 
P _picturo B _pksui9 

10 

[0098] The target quantity of bits which is allocated in coding a picture having the picture type of P -picture is found by 
equation (8). 

Tj Z*2i x „ (8) 

KpxKgxD ,+KqX £ D P +KpK £ D B 
P _ptcfuw e_ptoure 

20 

[0099] The target quantity of bits which is allocated in coding a picture having the picture type of B-picture is found by 
equation (9). 

r,- ^ x« O) 

K^KbxD,+KbK £ Dp+KpX £ . D B 

P _picturB B _pkxuro 

30 [0100] D|, Dp D B , commonly used in the denominators of all the these equations (7). (8) and (9). express the coding 
difficulties corresponding to the respective picture types and are data calculated prior to coding processing. K P 
expresses the ratio of the bit quantity of the l-picture to the bit quantity of the P-picture, and Kb expresses the ratio of 
the bit quantity of the l-picture to the bit quantity of the B-picture. For example, as proposed in the TM5 system, values 
such as K P = 1.0 and Kb = 1.4 are selected. 

35 [0101] To follow the limitation of calculation of a virtual buffer quantity (Video Buffering Verifier or VBV buffer) pre- 
scribed by MPEG, the value of the target quantity of codes Tj is limited so as not to exceed the limitation of the VBV 
buffer even when a quantity of generated codes Tj obtained by adding a certain marginal value to the bit quantity of the 
target quantity of codes Tj is generated. 

[0102] When the target quantity of codes Tj corresponding to each picture is determined, pictures of one GOP are 
40 encoded in accordance with the target quantity of codes Tj. 

[0103] Then, in the third processing, processing for updating equation (5) used in the first processing (processing for 
finding the reference GOP bit rate GOP_B'rtrate), that is, processing for updating the operation expression for calculat- 
ing the reference GOP bit rate GOP.Brtrate, is carried out 

[0104] In the third processing, the CPU 6 can obtain the quantity of actually generated bits in encoding the reference 

45 GOP, by encoding the reference GOP. 

[0105] First, in the case where this video data coding device is used in an authoring system or a storage system, the 
CPU 6 finds the quantity of remaining bits of a storage medium used in the authoring system or storage system and the 
remaining time, by arithmetic processing. This is because the CPU 6 calculates the new optimum average bit rate 
Rate_avg based on the quantity of remaining bits of the storage medium and the non-recording time of the source 

so material, before coding the next GOP after actually encoding the reference GOP. 

[01 06] The quantity of remaining bits Remain_Brt of the storage medium used in the authoring system or storage sys- 
tem is found by the following equation, where S represents the quantity of codes generated in encoding the reference 
GOP. 

55 Remain_BH = Remain_Bit-S (10) 

[0107] Subsequently, the non-recording time Remain_Time of the source material is found by the following equation, 
where Picture_Rate represents the number of pictures per second and N represents the number of picture per GOP. 
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Remain_Time = Rernain_J1me - (N/(Ptcutre_Rate)) (11) 

[0108] Thus, the new average bit rate Rate_Avg updated by the quantity of remaining bits of the storage medium and 
the non-recording time of the source material can be found by the following equation. 

5 

Rate_Avg s Remai n_Bit fbrteJ/Remai n_Time [sec} (1 2) 

[01 09] The initial values of Remain_Brt and Remain_Time are the total quantity of storage bits Total_Bit of the storage 
medium and the total data length TotaJ_Time of the source video material, respectively. 

w [01 1 0] On the other hand, in the case where this video date coding device is used in a transmission system of digital 
broadcast or the like, unlike the foregoing case of the authoring system or storage system, processing for updating the 
average bit rate Rate_avg is not carried out for the following reason. That is, this average bit rate cannot be changed 
since the average bit rate is a value preset with respect to each video program to be transmitted and is a bit rate used 
by the broadcasting station for charging the fee to a program supplier company which has requested transmission of a 

75 video program. 

[01 1 1 ] On completion of encoding of one GOP, the average value D of the coding difficulty in the next GOP is found 
before coding processing of the next GOP is carried out The CPU 6 updates the estimate value D_Avg of the average 
coding difficulty set for the next GOP to be encoded, by using the average value D of the coding difficulty in the present 
GOP. 

20 [01 1 2] The new estimate value D_Avg of the average coding difficulty used in coding the next GOP can be found by 
the following equation. 

DAvg = (*-1)xP_Avo+P (13) 

25 

As in this equation (13). it is easy to weight the previous D_Avg (estimate value of the average coding difficulty used in 
coding processing of the previous GOP) to find the average. In this equation, the coefficient k is a sufficientJy large inte- 
ger (for example. 256). The magnitude of the coefficient k is a time constant of fluctuation of the average value. As the 

30 coefficient k becomes greater, the fluctuation of the average value becomes smaller, but it takes longer to reach the 
actual average value. Therefore, the magnitude of the coefficient k must be selected in accordance with the application. 
[0113] As the initial value of the new estimate value D_Avg of the average coding difficulty, it can be considered to 
use a statistically found value. For example, it is appropriate to set a value which is assumed as the average coding dif- 
ficulty of the input video material, as the initial value, depending on encode conditions (resolution/pull -down) and the 

35 type of the input video material (motion picture/video, sports/news, and the like). In the case of the motion picture mate- 
rial, since 2-3 pull-down and improvement in the compression efficiency by frame DCT can be obtained, the average 
value of the difficulty is generally much smaller than that of a video material. Therefore, it is appropriate to set a rela- 
tively small value as the initial value. 

[0114] Meanwhile, when Rate_Avg and D_Avg are updated in accordance with equations (1 2) and (1 3) as a result of 
40 coding processing of the previous GOP, the conversion formula (5) for finding the GOP bit rate from the coding difficulty 
is updated on the basis of the updated Rate_Avg and D_Avg. Consequently, the conversion formula for finding the GOP 
bit rate from the coding difficulty is updated as shown in Fig. 7 and thus corrected to enable encoding within the range 
of the whole target quantity of codes. In the example of Fig. 7, since both the quantity of generated bits and the coding 
difficulty largely exceed the average value, Rate_Avg is reduced and D_Avg is increased to make the slope of the con- 
45 version formula (5) gentle. 

[0115] In this third processing, when the new conversion formula with respect to equation (5) is found, the operation 
returns to the first processing to determine the target quantity of codes for the next GOP. 
[01 1 6] Fig.8 is a flowchart showing detailed algorithms of the first to third processing. 

[01 1 7] The operation of the flowchart is executed by the CPU 6. First, at step Si , if this video data coding device is 
so used in an authoring system or a storage system, the user sets encode conditions such as the total quantity of codes 
of a storage disk, the length of a video material, the maximum bit rate, the mud bit rate, the type of the input video mate- 
rial, and the presence/absence of pull-down, through an input interface, not shown. On the basis of the input informa- 
tion, at step S2, the CPU 6 calculates the average bit rate Rate_Avg from the total quantity of codes Totaf_Brt of the disk 
and the temporal length Total_Time [sec] of the video material, in accordance with the following equation. 

55 

Rate_Avg = Total_Bit [brtsJ/TotaLTime [sec] 
[0118] If this video data coding device is applied to a data transmission system of digital broadcast or the like, a fixed 
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bit rate required in advance with respect to a video program to be transmitted is set as the average bit rate Rate_Avg. 
[01 1 9] Then, at step S3, the CPU 6 sets the initial value of the estimate value D_Avg of the average coding difficulty 
of the source video materia) to be encoded, in accordance with the encode conditions (resolution/pull-down) and the 
type of the input video materia) (motion picture/video, news/sports, and the like). 
5 [0120] Then, the CPU 6 starts GOP processing of step S4 and the subsequent steps. At step S5, if it is determined 
that the video signal input is the first GOP. the CPU 6 finds, at step S1 7. the coding difficulties Dj to Dj+ N corresponding 
to the picture types in accordance with the above-mentioned equations (1), (2) and (3), by using the index data (irrtra- 
AC and ME residual) for j+N pictures supplied from the coding preprocessing section 2. 

[0121 ] If it Is determined at step S5 that the input is not the first GOP. the CPU 6 finds, at step S6, the average value 
to D" of the coding difficulty in the reference GOP from the above-mentioned equation (4). In addition, the CPU 6 finds the 
bit rate GOP_Bitrate per GOP from the above-mentioned equation (5), by using the average value D* of the coding dif- 
ficulty in this GOP. The processing up to this point corresponds to the first processing. 

[01 22] Then, at step S7, the CPU 6 finds the target quantity of codes R allocated to the reference GOP, by using equa- 
tion (6). 

is [0123] Next, the CPU6 sets] =0at step S8and starts frame loop processing from step S10tostepS15. Atstep S11, 
the CPU 6 finds the coding difficulty of the j+N pictures in accordance with equations (1), (2) and (3), by using the index 
data (intra-AC and ME residual) supplied from the coding preprocessing section 2. 

[01 24] At step S 12, the CPU 6 finds the target quantities of codes Tj corresponding to the respective pictures, that is. 
the l-picture. P -picture and B-picture. in accordance with equations (7) to (9). Specifically, the target quantity of codes 

20 R allocated to the reference GOP. found by equation (6), is weighted by a weighting coefficient K set for each picture 
type, thereby distributing the target quantity of codes to each picture. At this point when there is no margin in the VBV 
buffer, the target quantity of codes Tj calculated for each picture is clipped. That is, in the case where the target quantity 
of codes Tj is greater than a value obtained by subtracting a margin from the buffer remaining quantity, the value of the 
calculated target quantity of codes Tj is limited to prevent overflow of the VBV buffer. 

25 [0125] Then, at step S1 3. the CPU 6 receives the quantity of generated codes generated by the encoder 4 in accord- 
ance with the target quantity of codes Tj, and stores this quantity of generated codes into a memory provided in the 
CPU 6. This series of processing is repeated until j = N is obtained at step S15, and the quantity of generated codes for 
one GOP is thus found. That is. encoding of one GOP is carried out The processing up to this point corresponds to the 
second processing. 

30 [0126] Next, the CPU 6 carries out processing corresponding to the third processing, at steps S20 and S21 . At step 
S20, similar to step S2. the CPU 6 finds the average bit rate Rate_Avg in coding remaining pictures in the reference 
GOP, from the quantity of remaining bits Remain_Bit [bits] of the storage medium and the non-recording tune 
Remain_Time [sec] of the source video material. This processing for finding the average bit rate Rate_Avg is carried 
out only in the case where coded data is to be recorded onto the storage medium. 

35 [0127] At step S21 . the CPU 6 finds a new average value D" of the coding difficulty corresponding to the next GOP 
by using the coding difficulty Dj calculated before coding the next GOP, in accordance with equation (4). thereby updat- 
ing the average value D" of the coding difficulty. Then, the CPU 6 updates the estimate value D_Avg of the average cod- 
ing difficulty in coding the next GOP, as described in equation (13), in accordance with the updating of the coding 
difficulty average value D". 

40 [0128] Thus, on the basis of the quantity of actually generated bits as a result of encode processing, the average bit 
rate Rate_Avg and the estimate value D_Avg of the average coding difficulty are updated. By entering these updated 
average bit rate Rate_Avg and estimate value D_Avg of the average coding difficulty into equation (5), the conversion 
formula for finding the GOP bit rate from the coding difficulty is changed, as shown in Fig. 7. Consequently, the conver- 
sion formula is corrected to enable encoding within the range of the whole target quantity of codes. 

45 [0129] Then, the operation returns to the first processing to determined the target quantity of codes for the next GOP, 
until termination of encode processing ts determined at step S22. 

[01 30] In the flowchart the relation between the coding difficulty and the bit rate is described as the linear relation as 
shown in Figs.6 and 7. In this invention, however, the relation between the coding difficulty and the bit rate need not be 
the linear relation and may be defined by a relational expression which has an exponentially gentle slope, as shown in 
so Rg.9. 

[01 31 ] In the embodiment of the present invention, the precedent reading algorithm for calculating (precedent fy read- 
ing) the coding difficulty Dj for one GOP prior to coding processing on the GOP basis is described for simplification. 
However, precedent reading for the GOP is not necessarily required. 

[01 32] If the coding difficulty for one GOP cannot be precedentfy read, precedent reading for one frame (one picture) 
55 may be sufficient In the first processing, the bit rate is determined in accordance with the coding difficulty on the GOP 
basis. However, if precedentiy read information of the GOP cannot be used, the target quantity of codes Tj can be 
directly determined in accordance with the corresponding relation between the coding difficulty of a predetermined 
frame and the target quantity of codes for the frame. That is, the first processing and the second processing are carried 
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out simultaneously. 

[01 33] Thus, in the algorithm for calculating the coding difficulty Dj for the I -picture, the relational expression between 
the coding difficuity on the picture basis and the target quantity of codes is prepared for each picture type in this case. 
Figs. 10A to 10C show examples thereof. The maximum and minimum target quantities of codes per picture with 
respect to the I -picture must be set to be greater than those for the P -picture and B-picture. Similarly, the average cod- 
ing difficulty D_Avg and the average target quantity of codes Avg Bits which are updated in the third processing must 
be found for each picture type. 

[0134] Fig. 1 0A is a graph showing the relational expression between the coding difficulty and the target quantity of 
codes for the I -picture. Fig. 1 0B is a graph showing the relational expression between the coding difficulty and the target 
quantity of codes for the P -picture. Fig. 10C is a graph showing the relational expression between the coding difficulty 
and the target quantity of codes for the B-ptcture. 

[0135] In the description up to this point even when a difference is generated in the quantity of generated codes with 
respect to the target quantity of codes on the picture basis or on the GOP basis, the difference is not immediately fed 
back but is moderately fed back in the form of updating the remaining average bit rate. This suffices in such an applica- 
tion that encoding for a relatively long time period is carried out to follow the target quantity, as in an authoring system 
or a storage system. 

[01 36] However, in the case where this video data coding device is applied to a transmission system of digital broad- 
cast or the like, the target quantity of codes and the quantity of generated codes must be approximated to each other 
within a short time period, depending on the application. In such case, it is conceivable to actively feed back the differ- 
ence between the bit quantity R allocated to one picture and the quantity of generated codes Sj, as in the TM5 system. 
That is, every time coding processing of one picture is completed, the bit quantity R allocated to the next picture is 
expressed by the following equation. 

R = R-S } 

In short the bit quantity R allocated to the next picture has a value obtained by subtracting the quantity of generated 
bits Sj generated in coding the previous picture from the bit quantity R allocated to the previous picture. 
[0137] The denominators of equations (7) to (9) may be calculated to find the sum of the coding difficulty of the 
remaining pictures in the GOP. Also, the difference can be fed back to the next GOP, by adding the value of the bit quan- 
tity R allocated to the picture on completion of the coding of the GOP to the bit quantity R allocated to the next GOP. 
[01 38] Although the example of weighting average (MR filter) as in equation (13) is described as a method for finding 
the prediction value D Avg of the average coding difficulty of the input video material, various other methods may be 
considered. In the following example, the average value of actually measured values of coding difficulty is used. 
[0139] On the assumption that precedent reading of the coding difficulty of L pictures from the start of encoding is 
completed at a certain time point, the actual average value can be used as expressed by the following equation. 

D_Avg = l -^j— (14) 

This equation (14) assumes that the average value of the past measured coding difficulties can be similarly used for a 
material to be inputted from now on. 

[0140] In this case, there is an advantage such that encoding for a long time period generates a value dose to the 
accurate average value, whereas there is a drawback that the average value is excessively affected by the input mate- 
rial immediately after the start of encoding. In addition, if encoding is continued for a long time period. L becomes too 
large and increases the calculation quantity and the storage quantity. 

[0141] As a special application example of the present invention, a one-pass fixed rate is included. Specifically, the 
one-pass fixed rate can be realized simply by setting the bit rate per GOP determined in the first processing of the 
present invention, cortstantty at a fixed value. 

[0142] In the above-described embodiment, in accordance with the feed forward rate control system, the statistically 
calculated index data, that is, the ME residual, flatness. intra-AC and activity; are made approximate to the coding diffi- 
culty by the CPU 6. These used data and the coding difficulty have strong correlation. However, there may be some 
errors depending on the pattern of video data. 

[0143] Therefore, by adaptively adjusting the weighting coefficients a,, a p a B denoted in equations (1), (2) and (3) in 
accordance with the pattern of video data, the coding difficulty with high precision can be found from the index data. 
Thus, compressed video data of higher quality may be generated. 

[0144] The processing for adaptively updating the weighting coefficients a ( , ap as will now be described. 
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[0145] Every time the encoder 4 of the video data coding device of Fig. 2 completes compression coding of one pic- 
ture, the CPU 6 learns the quantity of generated codes for one picture of the generated compressed video data, and 
can calculate the average value of quantization value Qj at the time of compression coding and the global complexity, 
which will be described hereinafter. 

[0146] The global complexity is data indicating complexity of a video pattern, and is defined as a value obtained by 
multiplying the quantity of generated codes (data quantity) of compressed video data and the quantization value Qj in 
the MPEG TM5 system, as expressed by the following equations (15) to (17). 

X^S.xQ, (15) 

Xp = SpxQ p (16) 

X B = S B xQ B (17) 

[0147] In equations (15) to (1 7), Xj Xp Xq represent the global complexities of the l-picture. P-picture and B-picture. 
respectively, and S|, Sp Sq represent the quantities of generated codes in coding the l-picture. P-picture and B-picture. 
respectively. Q\, Qp Qb represent the average values of the quantization value Qj in generating the l-picture, the P-pic- 
ture and B-picture, respectively. 

[0148] The global complexity X expressed by equations (15) to (17) does not necessarily coincide with the coding 
difficulty. However, it coincides substantially with the coding difficulty unless the average value of the quantization value 
Qj is extremely large or small. 

[0149] On the assumption that the index of the l-picture, P-picture and B-picture such as the intra-AC (or other param- 
eters) and ME residual are proportional to the global complexity, proportional coefficients q, Ep eg between these index 
data and the global complexity can be calculated by the following equations (18) to (20). 

[0150] The proportional coefficient ^ in coding a picture having the picture type of l-picture is expressed by the fol- 
lowing equation. 

''fmjSB (18) 



[0151 ] The proportional coefficient ep in coding a picture having the picture type of P-picture is expressed by the fol- 
lowing equation. 

•"/■'nfe? < 19 > 

[0152] The proportional coefficient cq in coding a picture having the picture type of B-picture is expressed by the fol- 
lowing equation. 

■ jAb (20 > 



[0153] The coding difficulties corresponding to the respective pictures are calculated as expressed by the following 

equations (21) to (23). by using the proportional coefficients tj, ep eq calculated by equations (18) to (20). 

[0154] The coding difficulty D'j in coding a picture having the picture type of l-picture is expressed by the following 

equation. 

D'j^e'jXintra.ACj (21) 

[01 55] The coding difficulty D p j in coding a picture having the picture type of P-picture is expressed by the following 
equation. 

D p j = e P j xME.residj (22) 
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[0156] The coding difficulty D B j in coding a picture having the picture type of B-picture is expressed by the following 
equation. 

D B j = e B j x ME.residj (23) 

[0157] As expressed in equations (21) to (23), the CPU 6 updates the proportional coefficients q, e p eq every time 
the encoder 4 compression-codes one picture, thereby finding the optimum coding difficulty D corresponding to each 
picture type. That is, by using the global complexity, the optimally approximated coding difficulty can be found con- 
io stantJy. 

[01 58] The CP U 6 carries out arithmetic processing of the algorithm of the flowchart of Fig .8 with respect to the coding 
difficulties calculated in accordance with equations (21) to (23). thus calculating the target quantity of codes T y 
[0159] The operation of the video data coding device for calculating the target quantity of codes from the coding dif- 
ficulty found by using the global complexity and then determining the quantity of generated codes in accordance with 
is the target quantity of codes will now be described. 

[0160] The coding preprocessing section 2 of Fig. 2 rearranges the video signal input in the coding order, then carries 
out picture-field conversion, and calculates the statistic quantity such as the flatness and intra- AC from the (j+N)th pic- 
ture which is to be compression-coded to an I -picture. 

[0161 ] The motion detection circuit 5 generates motion vectors with respect to the (j+N)th picture which is to be com- 
20 pression-coded to a P -picture and a B-picture, and calculates the ME residual. The FIFO 3 delays the inputted video 
signal by the amount of N pictures. 

[0162] With respect to a picture having the picture type of P -picture or B-picture, the CPU 6 carries out arithmetic 
processing of equation (22) or (23) using the ME residual generated by the motion detection circuit 5, thus calculating 
the coding difficulty. With respect to a picture having the picture type of (-picture, the CPU 6 carries out arithmetic 
25 processing of equation (21), thus finding the coding difficulty. 

[01 63] tn addition, the CPU 6 calculates the target quantity of codes Tj from the coding difficulty found for each picture, 
in accordance with the algorithm of Fig. 8, and sets this target quantity of codes Tj to the quantization control circuit 18 
shown in Rg.3 of the encoder 4. 

[0164] The DCT circuit 1 6 of the encoder 4 carries out DCT processing of the j-th picture of the delayed video data. 
30 [0165] The quantization circuit 1 7 quantizes the data of the frequency domain of the j-th picture inputted from the DCT 
circuit 16, by using the quantization value Qj adjusted by the quantization control circuit 18 on the basis of the target 
quantity of codes Tj, and calculates the average value of the quantization value Qj used for compression coding of the 
j-th picture. Then, the quantization circuit 17 outputs the average value to the CPU 6. 

[0166] The variable length coding circuit 19 carries out variable length coding of the j-th quantized data inputted from 
35 the quantization circuit 1 7, thus generating compressed video data of a data quantity substantially approximate to the 
target quantity of codes Tj. Then, the variable length coding circuit 19 outputs the compressed video data through the 
buffer memory 20. 

[0167] When the encoder 4 completes compression coding of the j-th picture, the CPU 6 calculates the global com- 
plexity as expressed by equations (15) to (17) on the basis of the average value of the quantization value Qj with respect 
40 to the j-th picture inputted from the quantization control circuit 1 8 and the data quantity of the compression-coded j-th 
picture. 

[0168] In addition, the CPU 6 updates the proportional coefficients e|, ep % as expressed by equations (18) to (20) 
by using the calculated global complexity. The updated proportional coefficients q, ep e^are reflected in the conversion 
formula in compression coding of the next picture. 

45 [0169] Meanwhile, though the video data coding device of Fig. 2 has a structure such that the CPU 6 is mounted 
therein, an external computer 30 may also be provided externally, as shown in Fig.1 1. In this case, encode conditions 
are provided from the external computer 30. The quantity of generated codes of the encoder 4 is notified of to the exter- 
nal computer 30 through the CPU 6. Alternatively, it is conceivable to cause only the external computer 30 to function 
in place of the CPU 6, as shown in Fig. 12. 

so [01 70] A recording medium such as a DVD on which coded data obtained by the video data coding device and method 
is recorded provides good picture quality by effectively using the limited quantity of bits. 

[0171 ] Also, in a video data transmitting method for transmitting coded data obtained by the coding method, data is 
transmitted after coding processing is carried out in accordance with the target quantity of codes calculated on the basis 
of the index data indexing characteristics of the input video signal. Thus, compression-coded data of good picture qual- 
55 ity can be transmitted in real time. 

[0172] As is described above, in the video data coding device and method according to the present invention, the CPU 
6 calculates the coding difficulty Dj indicating coding difficulty in coding source video data from the source video data 
to be coded itself, and calculates the target quantity of codes Tj used in coding the source video data to be coded, on 
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the basis of the calculated coding difficulty. Then, the CPU 6 supplies the calculated target quantity of codes T, to the 
encoder 4 in a manner ol feed forward, thereby enabling coding based on the target quantity of codes corresponding to 
the pattern of the source video data to be coded and real-time coding of video data. 

[0173] In addition, in the video data coding device according to the present invention, since the coding difficulty for 
5 each picture type is approximately calculated by using the irrtra-AC and ME residual found from the source video date 
to be coded, the coding difficulty can be obtained before actually encoding the video data to be coded. Thus, coding 
processing in real time can be realized 

[0174] Moreover, in the video data coding device according to the present invention, if the picture type of the video 
data to be coded is I -picture, the coding dfflicutty is calculated from the intra- AC. whereas if the picture type of the video 
10 data to be coded is P -picture or l-picture, the coding difficulty is calculated from the ME residual. Thus, the coding diffi- 
culty with high precision corresponding to the picture type can be calculated. 

[0175] fn addition, in the video data coding device according to the present invention, since the conversion formula 
for calculating the target quantity of codes from the calculated coding difficulty is constantly corrected on the basis of 
the quantity of codes actually generated as a result of the past coding processing by the coding means, the target quan- 

is trty of codes adapted for changes of the video data pattern and the target quantity of codes corresponding to the 
remaining recording quantity of the storage medium can be set Also, as the conversion formula for calculating the tar- 
get quantity of codes from the coding difficulty, different conversion formulas are set in accordance with the picture 
types of the video data to be coded. Therefore, not only the coding difficulty on the GOP basis but also the optimum 
coding diff iculty on the picture basis can be calculated. 

so [0176] Moreover, in the video data coding device according to the present invention, since the operation expression 
for calculating the coding difficulty is constantly updated on the basis of the global complexity found from the quantity 
of generated codes in coding processing by the coding means and the quantization value, the coding difficulty corre- 
sponding to changes of the video data pattern can be detected with higher precision. 

[0177] Also, in the video data coding device according to the present invention, the CPU 6 calculates the coding dif- 
25 f icutty for each of a plurality of pictures included in the reference GOP as a target of coding processing by the coding 
means, and calculates the target quantity of codes allocated to the reference GOP from the plurality of coding difficul- 
ties calculated by the coding difficulty calculation means. Then, the CPU 6 distributes the target quantity of codes allo- 
cated to the reference GOP, to each picture included in the reference GOP in accordance with the picture type, thereby 
calculating the target quantity of codes corresponding to each picture included in the reference GOP. Thus, within the 
30 GOP. different target quantities of codes corresponding to the picture types can be allocated to the respective pictures 
while the average quantity of codes designated to the GOP is maintained. 

Claims 

35 1 . A video data coding device for coding input video data supplied thereto, the device comprising: 

target quantity of codes calculation means for calculating a target quantity of codes to be distributed to the 
input video data on the basis of index data indexing characteristics of the input video data; 
delay means for delaying the input video data by a predetermined time period; and 
40 coding processing means, for carrying out coding processing in accordance with the target quantity of codes 

with respect to the input video data delayed by the delay means. 

2. The video data coding device as claimed in daim 1 , wherein the target quantity of codes calculation means f inds a 
coding difficulty indicating the difficulty at the time of coding from the index data, and calculates the target quantity 

45 of codes to be distributed to the video data on the basis of the coding difficulty. 

3. The video data coding device as claimed in claim 2, wherein the target quantity of codes calculation means 
updates, at any time, the corresponding relation of the target quantity of codes based on the coding difficufty. in 
accordance with coding difficulties that have already been collected and the quantity of codes generated by the 

so coding processing means. 

4. The video data coding device as claimed in claim 2, wherein the coding processing means codes the input video 
data for each picture coding group including predetermined numbers of intra-pictures, predictive-pictures and bidi- 
rectional ly predictive-pictures, and wherein the target quantity of codes calculation means precedentiy reads the 

55 coding difficulty for each picture coding group and determines the target quantity of codes for each picture coding 
group by using the corresponding relation of the target quantity of codes based on the coding difficufty. 

5. The video data coding device as claimed in claim 4, wherein the target quantity of codes calculation means distrib- 
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utes the target quantity of codes for each picture coding group in accordance with the ratio of coding difficulty for 
each coded picture, and determines the target quantity of codes for each coded picture. 

6. The video data coding device as claimed in claim 3, wherein the target quantity of codes calculation means defines 
5 the corresponding relation between the coding difficulty and the target quantity of codes as the corresponding rela- 
tion determined by a minimurn/maxirrturn bit rate designated in advance, an average bit rate calculated from the 
recording capacity and the value of remaining time, and an average value of coding difficulty of an input materia) 
which is the input video data, and updates, at any time, both or either one of the average bit rate and the average 
value of coding difficulty. 

10 

7. The video data coding device as claimed in claim 6, wherein the target quantity of codes calculation means varies 
an initial value of the average value of coding difficulty of the input video material in accordance with the type of 
material, resolution and presence/absence of pull-down. 

is 8. The video date coding device as claim ed in claim 6, wherein the target quantity of codes calculation means 
updates, at any time, the average value of coding difficulty of the input video material by averaging the value of 
actually obtained coding difficulty and a previous average value, when the coding difficulty is actually obtained. 

9. The video data coding device as claimed in claim 2, wherein the target quantity of codes calculation means calcu- 
20 lates the target quantity of codes for one frame precedentty read on the basis of the index data, from the coding 

difficulty of that frame by using the corresponding relation between the coding difficulty and the target quantity of 
codes. 

1 0. The video data coding device as claimed in claim 9, wherein the target quantity of codes calculation means pre- 
ss pares the corresponding relation between the coding difficulty and the target quantity of codes for one frame, with 

respect to each of intra-picture. predictive-picture and bidirectional ly predictive-picture, and calculates the target 
quantity of codes for each picture. 

1 1 . The video data coding device as claimed in claim 1 , wherein the index data is calculated by index data calculation 
30 means. 

12. The video data coding device as claimed in claim 11, wherein the index data calculation means includes statistic 
quantity calculation means for calculating a statistic quantity such as flatness, intra- AC data or activity for a picture 
to be compression-coded to an intra-picture. and ME residual detection means for detecting an ME residual as a 

35 prediction error quantity of motion prediction for pictures to be compression-coded to a predictive-picture and a bidi- 
rectionally predictive-picture. 

1 3. A video data coding method for coding input video data, the method comprising: 

40 a target quantity of codes calculation step of calculating a target quantity of codes to be distributed to the input 

video data on the basis of index data indexing characteristics of the input video data; 
a delay step of delaying the input video data by a predetermined time period; and 

a coding processing step of carrying out coding processing in accordance with the target quantity of codes with 
respect to the input video data delayed at the delay step. 

45 

14. The video data coding method as claimed in claim 13, wherein at the target quantity of codes calculation step, a 
coding difficulty indicating the difficulty at the time of coding is found from the index data, and wherein the target 
quantity of codes to be distributed to the video data is calculated on the basis of the coding difficulty. 

so 15. The video data coding method as claimed in claim 14, wherein at the target quantity of codes calculation step, the 
corresponding relation of the target quantity of codes based on the coding difficulty is updated at any time, in 
accordance with coding difficulties that have already been collected and the quantity of codes generated at the cod- 
ing processing step. 

55 16. The video data coding method as claimed in claim 14, wherein at the coding processing step, the input video data 
is coded for each picture coding group including predetermined numbers of tntra-pictures, predictive-pictures and 
btdirectionally predictive-pictures, and wherein at the target quantity of codes calculation step, the coding difficulty 
is precedently read for each picture coding group, thus determining the target quantity of codes for each picture 
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coding group by using the corresponding relation of the target quantity of codes based on the cooing difficulty. 

1 7. The video data coding method as claimed in claim 16, wherein at the target quantity of codes calculation step, the 
target quantity of codes for each picture coding group is distributed in accordance with the ratio of coding difficulty 

5 for each coded picture, thus determining the target quantity of codes for each coded picture. 

18. The video data coding method as claimed in claim 15, wherein at the target quantity of codes calculation step, the 
corresponding relation between the coding difficulty and the target quantity of codes is defined as the correspond- 
ing relation determined by a minimunVmaximum bit rate designated in advance, an average bit rate calculated from 

w the recording capacity and the value of remaining time, and an average value of coding difficulty of an input material 
which is the input video data, thus updating both or either one of the average bit rate and the average value of cod- 
ing difficulty at any time. 

1 9. The video data coding method as claimed in claim 1 8. wherein at the target quantity of codes calculation step, an 
75 initial value of the average value of coding difficulty of the input video material is varied in accordance with the type 

of material, resolution and presence/absence of pull-down. 

20. The video data coding method as claimed in claim 18, wherein at the target quantity of codes calculation step, the 
average value of coding difficulty of the input video material is updated at any time by averaging the value of actu- 

20 ally obtained coding difficulty and a previous average value, when the coding difficulty is actually obtained. 

21 . The video data coding method as claimed in claim 14, wherein at the target quantity of codes calculation step, the 
target quantity of codes for one frame precedently read on the basis of the index data is calculated from the coding 
difficulty of that frame by using the corresponding relation between the coding difficulty and the target quantity of 

25 codes. 

22. The video data coding method as claimed in claim 21 , wherein at the target quantity of codes calculation step, the 
corresponding relation between the coding difficulty and the target quantity of codes for one frame is prepared with 
respect to each of intra-picture, predictive-picture and bidirectional ly predictive-picture, thus calculating the target 

30 quantity of codes for each picture. 

23. The video data coding method as claimed in claim 1 3. wherein flatness, intra- AC data and activity or a combination 
thereof is used as the index data for a picture to be compression-coded to an intra-picture. and wherein an ME 
residual as a prediction error quantity of motion prediction is used as the index data for pictures to be compression- 
's coded to a predictive-picture and a bdirectionally predictive-picture. 

24. A video data coding device for coding source video data, the device comprising: 

coding difficulty calculation means for calculating a coding difficulty indicating coding difficulty in coding the 
40 source video data, from source video data to be coded rtsetf; 

target quantity of codes calculation means for calculating a target quantity of codes used in coding the source 
video data to be coded, on the basis of the calculated coding difficulty; and 

coding means for coding the source video data to be coded in real time on the basis of the target quantity of 
codes corresponding to the source video data to be coded, by feeding forward the target quantity of codes cal- 
45 culated by the target quantity of codes calculation means. 

25. The video data coding device as claimed in claim 24, wherein the coding difficulty calculation means calculates the 
coding difficulty on the basis of a statistic quantity found from the source video data to be coded. 

so 26. The video data coding device as claimed in claim 24, wherein the coding difficulty calculation means calculates the 
coding difficulty for each picture type by using intra-AC or ME residual found from the source video data to be 
coded. 

27. The video data coding device as claimed in claim 26. wherein the coding difficulty calculation means calculates the 
55 coding difficulty from the intra-AC in the case where the picture type of the video data to be coded is l-ptcture. and 
calculates the coding diff iculty from the ME residual in the case where the picture type of the video data to be coded 
is P -picture or B-picture. 
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28. Hie video data coding device as claimed in claim 24. wherein the target quantity of codes calculation means cal- 
culates the target quantity of codes from the coding difficulty by using a conversion formula for calculating the target 
quantity of codes from the coding difficutty calculated by the coding difficulty calculation means, and corrects the 
value of the calculated target quantity of codes by correcting the conversion formula on the basts of a quantity of 

5 codes generated as a result of coding processing by the coding means. 

29. The video data coding device as claimed in claim 28, wherein as the conversion formula for calculating the target 
quantity of codes from the coding difficulty, different conversion formulas are set in accordance with picture types 
of the video data to be coded. 

10 

30. The video data coding device as claimed in claim 29. wherein the conversion formula for calculating the target 
quantity of codes from the coding difficulty is a conversion formula determined on the basis of the average com- 
plexity per coding unit period and the target quantity of codes per coding unit period, and wherein the conversion 
formula for calculating the target quantity of codes from the coding difficutty is corrected by varying the value of the 

is average complexity per coding unit period. 

31 . The video data coding device as claimed in claim 24. wherein the coding difficulty calculation means updates, at 
any time, an operation expression for calculating the coding difficulty on the basis of coding results of coding 
processing by the coding means. 

20 

32. The video data coding device as claimed in daim 24, wherein the coding difficulty calculation means updates, at 
any time, an operation expression for calculating the coding difficulty on the basis of global complexity found from 
the quantity of generated codes and the quantization value of coding processing by the coding means. 

25 33. The video data coding device as claimed in claim 24, wherein the target quantity of codes calculation means cal- 
culates the target quantity of codes allocated to a reference picture as a target of coding processing from the coding 
difficulty calculated by the coding difficulty calculation means, on the basis of a plurality of different conversion for- 
mulas which are formulas for calculating the target quantity of codes from the coding difficulty and are set for 
respective picture types. 

30 

34. The video data coding device as claimed in claim 33, wherein in the plurality of conversion formulas set for respec- 
tive picture types, different maximum values for respective pictures for limiting an upper limit of the target quantity 
of codes are set 

35 35. The video data coding device as claimed in claim 24, wherein the coding difficutty calculation means calculates the 
coding diff iculty for each of a plurality of pictures included in a coding unit period of the coding means, and 

wherein the target quantity of codes calculation means calculates the target quantity of codes allocated to 
the coding unit period from a plurality of coding difficulties calculated by the coding difficulty calculation means, and 
calculates the target quantity of codes corresponding to each picture by distributing the target quantity of codes 

40 allocated to the coding unit period, to each picture included in the coding unit period in accordance with the picture 
type. 

36. The video data coding device as claimed in claim 24, wherein the coding difficulty calculation means calculates the 
coding difficulty for each of a plurality of pictures included in a reference GOP as a target of coding processing by 

45 the coding means, and wherein 

the target quantity of codes calculation means calculates the target quantity of codes allocated to the reference 
GOP from a plurality of coding difficulties calculated by the coding difficulty calculation means, and calculates 
the target quantity of codes corresponding to each picture included in the reference GOP by distributing the 
so target quantity of codes allocated to the reference GOP, to each picture included in the reference GOP. 

37. The video data coding device as claimed in claim 24, wherein the coding difficulty calculation means calculates the 
coding difficulty for each of a plurality of pictures included in a reference GOP as a target of coding processing by 
the coding means, and wherein 

55 

the target quantity of codes calculation means calculates an average value of coding difficulty in the reference 
GOP from a plurality of coding difficulties calculated by the coding difficulty calculation means, then calculates 
the target quantity of codes allocated to the reference GOP from the calculated average value of coding diffi- 
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cutty, and calculates the target quantity of codes corresponding to each picture by distributing the target quan 
trty of codes allocated to the reference GOP, to each picture included in the reference GOP. 



38. A video data coding device for coding source video data, the device comprising: 

5 

coding difficulty calculation means for calculating a coding difficulty indicating coding difficulty in coding the 
source video data; 

target quantity of codes calculation means for updating, at any time, an operation expression for calculating a 
target quantity of codes used in coding the source video data from the calculated coding difficulty on the basis 
to of the quantity of generated codes in the past coding processing, and calculating the target quantity of codes 

from the coding difficulty on the basis of the updated operation expression; and 

coding means for coding the source video data to be coded in real time on the basis of the target quantity of 
codes corresponding to the source video data to be coded, by feeding forward the target quantity of codes cal- 
culated by the target quantity of codes calculation means. 

is 

39. A video data coding device for coding source video data, the device comprising: 

coding difficulty calculation means for updating an operation expression for calculating a coding difficulty indi- 
cating coding difficulty in coding the source video data on the basis of an actual quantity of codes generated in 
so the past coding processing, and calculating the coding difficulty on the basis of the updated operation expres- 

sion: 

target quantity of codes calculation means for calculating a target quantity of codes used in coding the source 
video data to be coded on the basis of the calculated coding difficulty; and 

coding means for coding the source video data to be coded in real time on the basis of the target quantity of 
25 codes corresponding to the source video data to be coded, by feeding forward the target quantity of codes cal- 

culated by the target quantity of codes calculation means. 



40. A video data coding device for coding source video data, the device comprising: 



30 coding difficulty calculation means for updating an operation expression for calculating a coding difficulty indi- 

cating coding difficulty in coding the source video data on the basis of an actual quantity of codes generated in 
the past coding processing, and calculating the coding difficulty on the basis of the updated operation expres- 
sion; 

target quantity of codes calculation means for updating, at any time, an operation expression for calculating a 
35 target quantity of codes used in coding the source video data from the calculated coding difficulty, on the basis 

of the quantity of generated codes in the past coding processing, and calculating the target quantity of codes 
from the coding difficulty on the basis of the updated operation expression; and 

coding means for coding the source video data to be coded in real time on the basis of the target quantity of 
codes corresponding to the source video data to be coded, by feeding forward the target quantity of codes cal- 
40 culated by the target quantity of codes calculation means. 

41 . A video data coding method for coding source video data, the method comprising the steps of: 

calculating a coding difficulty indicating coding difficulty in coding the source video data from source video data 
45 to be coded itself, and calculating a target quantity of codes used in coding the source video data to be coded, 

on the basis of the calculated coding difficulty; and 

feeding forward the calculated target quantity of codes, thereby coding the source video data to be coded in 
real time on the basis of the target quantity of codes corresponding to the source video data to be coded. 



so 42. A video data coding method for coding source video data, the method comprising the steps of: 



calculating a coding difficulty indicating coding difficulty in coding the source video data; 
updating, at any time, an operation expression for calculating a target quantity of codes used in coding the 
source video data from the calculated coding difficulty, on the basis of the quantity of generated codes in the 
£5 past coding processing, and calculating the target quantity of codes from the coding difficulty on the basts of 

the updated operation expression; and 

feeding forward the calculated target quantity of codes, thereby coding the source video data to be coded in 
real time on the basis of the target quantity of codes corresponding to the source video data to be coded. 
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43. A video data coding method for coding source video data, the method comprising the steps of: 

updating an operation expression for calculating a coding difficulty indicating coding difficulty in coding the 
source video data on the basis of an actual quantity of codes generated in the past coding processing, and cal- 
s culating the coding difficulty on the basis of the updated operation expression; 

calculating a target quantity of codes used in coding the source video data to be coded on the basis of the cal- 
culated coding difficulty; and 

feeding forward the calculated target quantity of codes, thereby coding the source video data to be coded in 
real time on the basis of the target quantity of codes corresponding to the source video data to be coded. 

io 

44. A video data coding method for coding source video data, the method comprising the steps of: 

updating an operation expression for calculating a coding difficufty indicating coding difficulty in coding the 
source video data on the basis of an actual quantity of codes generated in the past coding processing, and cal- 
15 culating the coding difficufty on the basts of the updated operation expression; 

updating, at any time, an operation expression for calculating a target quantity of codes used in coding the 
source video data from the calculated coding difficulty, on the basis of the quantity of generated codes in the 
past coding processing, and calculating the target quantity of codes from the coding difficulty on the basis of 
20 the updated operation expression; and 

feeding forward the calculated target quantity of codes, thereby coding the source video data to be coded in 
real time on the basis of the target quantity of codes corresponding to the source video data to be coded. 

25 45. A video data transmitting device for coding source video data and transmitting the coded video data, the device 
comprising: 

coding difficulty calculation means for calculating a coding difficulty indicating coding difficufty in coding the 
source video data; 

30 

target quantity of codes calculation means for updating, at any time, an operation expression for calculating a 
target quantity of codes used in coding the source video data from the calculated coding difficulty, on the basis 
of the quantity of generated codes in the past coding processing, and calculating the target quantity of codes 
from the coding difficulty on the basis of the updated operation expression; 

35 

coding means for feeding forward the target quantity of codes calculated by the target quantity of codes calcu- 
lation means, thereby coding the source video data to be coded in real time on the basis of the target quantity 
of codes corresponding to the source video data to be coded; and 

40 transmission means for transmitting the video data coded by the coding means. 

46. A video data transmitting device for coding input video data supplied thereto and transmitting the coded video data, 
the device comprising: 

45 target quantity of codes calculation means for calculating a target quantity of codes to be distributed to the 

input video data on the basis of index data indexing characteristics of the input video data; 

delay means for delaying the input video data by a predetermined time period; and 

so coding transmission means for carrying out coding processing in accordance with the target quantity of codes 

with respect to the input video data delayed by the delay means, and transmitting the coded video data. 

47. A video data recording medium in which coded data is recorded, the coded data being obtained by calculating a 
target quantity of codes to be distributed to input video data on the basis of index data indexing characteristics of 

55 the input video data, and then carrying out coding processing in accordance with the target quantity of codes wfth 
respect to the input video data delayed by a predetermined time period. 
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